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Resumo: We analyze the behavior of bursts of neural ac- 
tivity in the Kinouchi-Copelli model, originally conceived 
to explain information processing issues in sensory systems. 
We show that, at a critical condition, power-law behavior 
emerges for the size and duration of the bursts (avalanches), 
with exponents experimentally observed in real biological 
systems. 

Palavras-chave: Neuro-dynamics, critical phenomena, 
avalanches 

1. INTRODUCTION 

The theory of critical phenomena in equilibrium statisti- 
cal physics became one of the landmarks of Physics in the 
last century (culminating with the Nobel prize for Kenneth 
Wilson in 1982) because, among other things, it offered an 
explanation for the phenomenon of universality, where phys- 
ical systems in principle very distinct, like a magnet and a 
fluid, can present the same behavior (even in a quantitative 
sense) in some key quantities when they are all close to a 
so-called critical point. Namely, the magnetization in some 
model magnets and the difference of density of gas and liquid 
phases in a fluid both behave as power-laws with the same 
exponent as functions of the temperature when this control 
parameter is close enough to a critical value. 

The ubiquity of power-laws in nature suggested that the 
concept of criticality could be extended to nonequilibrium 
settings and then become relevant also to the understanding 
of phenomena in domains outside "regular" physics, like bi- 
ological and geophysical systems, for instance. Neverthe- 
less there is still no general theoretical formalism for such 
"nonequilibrium-criticality" and there is few (if any) uncon- 
troversial experimental evidence of a role of criticality in the 
nonequilibrium processes observed in nature. One research 



avenue where such evidence could rise is the study of brain 
dynamics. 

In the last decade, experiments with cortical networks 
both in vivo and in vitro Q have revealed activation patterns 
of neurons characterized by power-law distributions in the 
number of units that got eventually excited as well as in the 
total duration of a burst of activity. We will call such pro- 
cesses as neuronal avalanches or simply avalanches, in spite 
of the fact that other researchers use that expressions for any 
pattern of neural activity (what obliges them to introduce ad- 
ditional qualifiers as "scale-free", "critical" or "power-law 
distributed" when they talk about the avalanches we are in- 
terested in this paper). 

Those experiments were interpreted as manifestations of 
self-organized criticality (SOC) Q, a theoretical proposal for 
general nonequilibrium critical behavior by which the inter- 
actions among the units of complex systems would "natu- 
rally" evolve in time towards a condition where the asymp- 
totic spatial-temporal activity would be characterized by 
power-law distributions. It is important to note the absence of 
a human-tuned control parameter as temperature in the equi- 
librium critical phenomena. It would be hard to conceive an 
alternative framework that looks more suited to describe the 
synaptic dynamics of neural systems. Even so, despite ap- 
pealing, SOC received many criticisms because of the lack 
of any precise description of the general mechanisms of the 
underlying adaptive process and also because of the lack of 
an unambiguous signature, both in neuroscience and other 
applications. Indeed, many recent works have focused in 
exhibiting scale-free behavior without any explicit adaptive 
SOC-like mechanism 0. 

In this paper we analyze the avalanches that arise in a 
model (4) conceived by Osame Kinouchi and Mauro Copelli 
(KC hereafter) to explain how sensory systems could be able 



to discriminate signals spanning many orders of magnitude 
in intensity. This interval of values of a signal discriminable 
by a system is called dynamic range. Remarkably, KC found 
out that at least some classes of networks of excitable ele- 
ments may exhibit an optimal (larger) dynamic range at a 
critical condition. However, it should be stressed that such 
a nonequilibrium phase transition is not self-organized at all 
(there is no adaptive process and a proper control parame- 
ter must be "tuned"). Experiments with cortical slices even 
inspired speculations regarding a possible causal connection 
between avalanches and an optimal dynamic range [5 ]. Any- 
way, the authors of [4 ] have made some comments on the 
nature of the avalanches in their model but, to the best of 
our knowledge, have not publicly characterized that critical 
bursts, what we do in this study. 

This paper is organized as follows. We define the 
Kinouchi-Copelli model in section [2] We exhibit the 
avalanches (size and time) probability distributions in sec- 
tion [3] In section [4] we summarize our results and indicate 
directions for further investigations. 

2. KINOUCHI-COPELLI MODEL 

Consider an undirected weighted Erdos-Renyi random 
graph with N nodes. Each node represent a neuron, i.e. an 
excitable unit whose possible states will be described below. 
Given a desired average connectivity K (mean degree of a 
node) for the graph, each of the NK/2 edges is assigned to 
a randomly chosen pair of nodes. Let Vj be neighborhood of 
node j, i.e. the set of nodes connected to j by an edge. The 
strength of a synapse in this neuronal network is represented 
by the weight of the corresponding edge in this graph and 
is sorted from an uniform probability density in the interval 
[0,£>maj, where < p m ax < 1- Representing the absence 
of a synapse as a null weight, we can define an (symmetric) 
adjacency matrix A whose element Ajk is the weight of the 
edge between nodes j and k. 

Let Xj (t) be a random variable representing the state of 
the j-th neuron at the instant t. For all j and t, Xj(t) ex- 
hibits realizations in the set {0, 1, • • • , m — 1}. The state 
is called either the quiescent state or the rest state. The state 
1 is the excited state and all other states are called refractory 
states. The full dynamics of the system consists in the tem- 
poral evolution of the family {Xj(t)} in discrete time, with 
synchronous updating, according to the following rules: 

• if 1 < Xj(t) < m - 2, then Xj(t + 1) = Xj(t) + 1; 

• ifXj(t) = m - 1, then Xj(t + 1) = 0; 

• if Xj(t) = 0, then Xj(t + 1) will be either or 1, and 
the total excitation probability of neuron j depends on 
independent contributions from 

- an external stimulus with probability m 

- each of its excited neighbors, say k, with probabil- 
ity A jk . 

Explicitly, "independent contributions" mean that each of the 
numbers r\ and {Ajk} are meaningful as excitation proba- 
bilities only in isolation (absence of all other contributions). 
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Figure 1 - Typical behaviour of the activity F as a function of 
the excitation rate r. The dashed line is a mean-field solution 
proposed by KC |4 1. 



Also notice that the refractory period of a neuron equals 
m — 1 time steps, starting right after this neuron getting ex- 
cited. Its evolution is deterministic meanwhile. The only 
probabilistic state transition occurs from the quiescent state 
to the excited one. 

For KC r] = 1 — e _rA£ , where At would be an arbitrary 
continuous time interval (usually, At « 1 ms) and r would 
be the probability rate of a Poisson process. In olfactory in- 
traglomerular neuronal networks (a biological system where 
the KC model may be applicable), r would be directly re- 
lated to the concentration of an odorant capable of exciting 
neurons. 

The main observables of the KC model are the density of 
excited neurons p(t) at t-th time step (the fraction of the pop- 
ulation of neurons composed by excited units) and its tempo- 
ral average, the activity of the network, 

t=l 

For large enough (« 10 3 ms) values of the observation win- 
dow T, so that a dynamical equilibrium is reached, its precise 
value does not have relevant effects on the behavior of F. 
Then the activity can be seen as a function of the excitation 
rate r as shown in Fig. [T] 

The critical behavior is revealed only when Ar*, the 
range of values of r over which F exhibits "significant" vari- 
ation (4), is seen as a function of the average branching ratio 
cr, defined as the mean value (averaged over all the neurons) 
of the local branching ratio crj of the j-th node, 

o-j = J2 A ok- (2) 

keVj 

Indeed, the dynamic range Ar* turns out to be optimal when 
a = 1. So the role of control parameter is performed by a, 
which is a measure of how much activity can be directly gen- 
erated by an excited unit of the network stimulating a resting 
neighborhood. 



3. EMERGENCE OF AVALANCHES AT CRITICAL- 
ITY 

It is not our interest here to discuss the optimal dynamic 
range, despite that being the major result in Instead, we 
are concerned with the dynamical properties of the KC model 
when there is a non-null initial density of excited neurons and 
the external stimulus is turned off. As already discussed in 
|4|, for a < 1, F = 0, i.e., any given signal (initial condition) 
is damped; for a > 1, F ^ 0, i.e., the signal is self- sustained 
by the network. How the patterns of neural activity depend 
on a? KC already pointed out there are avalanches when 
cr = l but did not characterize such bursts. In the following, 
we discuss the methodology we have employed to character- 
ize the avalanches and present the distributions of size and 
duration of that events. 

3.1. Methodology 

To probe the capability of the KC network in propagat- 
ing a signal, we induce a burst of activity by exciting a ran- 
domly chosen single neuron and keeping the external stim- 
ulus turned off. The duration of a burst is the number of 
time steps in which there is at least one active unit. The burst 
size is the total number of neurons that got eventually excited 
(avoiding multiple counts). We repeat this procedure a great 
number of times (typically 2 • 10 5 ) to generate the data we 
analyze in the following subsections. 

There, we exhibit the probability density functions (PDF) 
and the cumulative distribution functions (CDF) for both size 
and duration of bursts. Clearly, the PDF's in the critical con- 
dition of the KC model (a = 1) are power laws. It is easy to 
see that a CDF of such a PDF is a power law too. We have 
used the CDF's to estimate the power-law exponents as is 
usually recommended (51 Hi. We have not shown any super- 
critical curves because they are as different from the critical 
behavior as are the subcritical data and therefore they would 
not be illustrative at all. 

3.2. Distribution of avalanche sizes 

The PDF's for three values of the average branching ra- 
tio a are shown in Fig. [2] It is reasonable to say that we 
have a power law only in the critical case, but it becomes 
"crystal clear" in Fig. [3] There we see an exponent close to 
— 1/2 that indirectly implies an exponent close to —3/2 for 
the PDF. This corroborates a comment by KC | 4 ] and agrees 
with experimental measurements |5|. It is important to no- 
tice that the power-law behavior in Fig. [3] extends for almost 
four orders of magnitude, a very robust signature indeed. 

3.3. Distribution of avalanche times 

The analysis is performed analogously to the case of size 
distribution. The results are shown in Figs. [4] and [5] We 
extract an exponent close to —2 for the PDF from the expo- 
nent — 1 in the corresponding CDF. This is in agreement with 
the experimental result of J. Beggs and D. Plenz (1, 8 ] that 
initiated the search for criticality in brain dynamics and indi- 
rectly motivated the present paper. That fact was not reported 
in (4). Finally we notice that the power-law behavior in Fig. 
[5] extends only for almost three orders of magnitude. 
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Figure 2 - PDF of avalanche size for three different values of a. 
The power law emerges only in the critical condition (a — 1). 
Data from networks with 10 5 neurons, m = 10 refractory states 
and mean connectivity K — 10. 
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Figure 3 - CDF of avalanche size in the critical condition (a — 
1). The power law behavior extends for almost four orders of 
magnitude. Data from networks with 10 5 neurons, m = 10 
refractory states and mean connectivity K — 10. 



4. CONCLUSION AND FUTURE DIRECTIONS 

We have analyzed the avalanche behavior in the 
Kinouchi-Copelli model. It reveals the exponents —3/2 and 
—2 for the power laws characterizing the size and duration of 
the avalanches, respectively. It is noteworthy that both expo- 
nents have already been experimentally observed dEHUE). 
Therefore our study fits in the search for criticality in brain 
dynamics, despite not being related to self-organized criti- 
cality. In the near future we intend to investigate: (i) the 
effect of different network topologies, (ii) finite-size effects 
and (iii) how the properties of avalanches would be affected 
by the competition among avalanches that certainly occurs in 
real biological systems. 
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Figure 5 - CDF of avalanche time in the critical condition (a = 
1). The power law behavior extends for almost four orders of 
magnitude. Data from networks with 10 5 neurons, m = 10 
refractory states and mean connectivity K = 10. 
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